Digital Fabrication Approaches for the Design and Development of Shape-Changing Displays

Interactive shape-changing displays enable dynamic representations of data and information through physically reconfigurable geometry. The actuated physical deformations of these displays can be utilised in a wide range of new application areas, such as dynamic landscape and topographical modelling, architectural design, physical telepresence and object manipulation. Traditionally, shape-changing displays have a high development cost in mechanical complexity, technical skills and time/finances required for fabrication. There is still a limited number of robust shape-changing displays that go beyond one-off prototypes. Specifically, there is limited focus on low-cost/accessible design and development approaches involving digital fabrication (e.g. 3D printing). To address this challenge, this thesis presents accessible digital fabrication approaches that support the development of shape-changing displays with a range of application examples – such as physical terrain modelling and interior design artefacts. Both laser cutting and 3D printing methods have been explored to ensure generalisability and accessibility for a range of potential users. The first design-led content generation explorations show that novice users, from the general public, can successfully design and present their own application ideas using the physical animation features of the display. By engaging with domain experts in designing shape-changing content to represent data specific to their work domains the thesis was able to demonstrate the utility of shape-changing displays beyond novel systems and describe practical use-case scenarios and applications through rapid prototyping methods. This thesis then demonstrates new ways of designing and building shape-changing displays that goes beyond current implementation examples available (e.g. pin arrays and continuous surface shape-changing displays). To achieve this, the thesis demonstrates how laser cutting and 3D printing can be utilised to rapidly fabricate deformable surfaces for shape-changing displays with embedded electronics. This thesis is concluded with a discussion of research implications and future direction for this work

PolySurface:a design approach for rapid prototyping of shape-changing displays using semi-solid surfaces

We present a design approach for rapid fabrication of high fidelity interactive shape-changing displays using bespoke semi-solid surfaces. This is achieved by segmenting virtual representations of the given data and mapping it to a dynamic physical polygonal surface. First, we establish the design and fabrication approach for generating semi-solid reconfigurable surfaces. Secondly, we demonstrate the generalizability of this approach by presenting design sessions using datasets provided by experts from a diverse range of domains. Thirdly, we evaluate user engagement with the prototype hardware systems that are built. We learned that all participants, all of whom had no previous interaction with shape-changing displays, were able to successfully design interactive hardware systems that physically represent data specific to their work. Finally, we reflect on the content generated to understand if our approach is effective at representing intended output based on a set of user defined functionality requirements

3D Printed Deformable Surfaces for Shape-Changing Displays

We use interlinked 3D printed panels to fabricate deformable surfaces that are specifically designed for shape-changing displays. Our exploration of 3D printed deformable surfaces, as a fabrication technique for shape-changing displays, shows new and diverse forms of shape output, visualizations, and interaction capabilities. This article describes our general design and fabrication approach, the impact of varying surface design parameters, and a demonstration of possible application examples. We conclude by discussing current limitations and future directions for this work

PolySurface: a design approach for rapid prototyping of shape-changing displays using semi-solid surfaces

We present a design approach for rapid fabrication of high fidelity interactive shape-changing displays using bespoke semi-solid surfaces. This is achieved by segmenting virtual representations of the given data and mapping it to a dynamic physical polygonal surface. First, we establish the design and fabrication approach for generating semi-solid reconfigurable surfaces. Secondly, we demonstrate the generalizability of this approach by presenting design sessions using datasets provided by experts from a diverse range of domains. Thirdly, we evaluate user engagement with the prototype hardware systems that are built. We learned that all participants, all of whom had no previous interaction with shape-changing displays, were able to successfully design interactive hardware systems that physically represent data specific to their work. Finally, we reflect on the content generated to understand if our approach is effective at representing intended output based on a set of user defined functionality requirements

ShapeCanvas: an exploration of shape-changing content generation by members of the public

Shape-changing displays--visual output surfaces with physically-reconfigurable geometry---provide new challenges for content generation. Content design must incorporate visual elements, physical surface shape, react to user input, and adapt these parameters over time. The addition of the ‘shape channel’ significantly increases the complexity of content design, but provides a powerful platform for novel physical design, animations, and physicalizations. In this work we use ShapeCanvas, a 4×4 grid of large actuated pixels, combined with simple interactions, to explore novice user behavior and interactions for shape-change content design. We deployed ShapeCanvas in a café for two and a half days and observed users generate 21 physical animations. These were categorized into seven categories and eight directly derived from people’s personal interest. This paper describes these experiences, the generated animations and provides initial insights into shape- changing content design

Supporting Prototyping of Novel Interfaces Using Laser Cut Clear Perspex

Digital fabrication technologies such as laser cutters have been widely used for supporting prototyping of interactive devices as they are able to work with a wide range of materials. However, the majority of laser cut prototype components are often unable to support interaction or visualisation capabilities within themselves (e.g., functionality embedded within the material). Often materials that are laser cut do not have functional properties aside from serving as enclosures for interactive components. Our work explores how optical properties of clear Perspex material can be exploited to support interaction and visualisation capabilities for interface prototyping. Our proposed fabrication approach demonstrates the potential to support the development of novel displays devices that do not require expensive or complex circuitry and electronics. We produce a light-sensitive button and a seven-segment display which are combined into a wearable watch prototype demo. We also discuss design implications and future direction for this work

Digital-is-Physical:How Functional Fabrication Disrupts Ubicomp Design Principles

Ubiquitous computing has long explored design through the conceptual separation of digital and physical materials. We describe how the emergence of the fabrication community in HCI will challenge these conceptual principles. The idea of digital material in ubicomp ‘hides’ lower level abstractions such as physical architectures and materials from designers. As new fabrication techniques make these abstractions accessible to makers, physical materials are being used to encode digital functionality. Form (traditionally physical) and function (traditionally digital) can be mutually expressed within material design. We outline how emerging printed electronics techniques will enable functional fabrication, current limitations and opportunities for end-user fabrication of functional devices, and implications for new principles that emphasise combined physical design of form and function

Multiscale human activity recognition and anticipation network

Deep convolutional neural networks have been leveraged to achieve huge improvements in video understanding and human activity recognition performance in the past decade. However, most existing methods focus on activities that have similar time scales, leaving the task of action recognition on multiscale human behaviors less explored. In this study, a two-stream multiscale human activity recognition and anticipation (MS-HARA) network is proposed, which is jointly optimized using a multitask learning method. The MS-HARA network fuses the two streams of the network using an efficient temporal-channel attention (TCA)-based fusion approach to improve the model's representational ability for both temporal and spatial features. We investigate the multiscale human activities from two basic categories, namely, midterm activities and long-term activities. The network is designed to function as part of a real-time processing framework to support interaction and mutual understanding between humans and intelligent machines. It achieves state-of-the-art results on several datasets for different tasks and different application domains. The midterm and long-term action recognition and anticipation performance, as well as the network fusion, are extensively tested to show the efficiency of the proposed network. The results show that the MS-HARA network can easily be extended to different application domains

ActuEating: Designing, Studying and Exploring Actuating Decorative Artefacts

Actuating, dynamic materials offer substantial potential to enhance interior designs but there are currently few examples of how they might be utilised or impact user experiences. As part of a design-led exploration, we have prototyped (Wizard-of-Oz) an actuating, dining table runner (ActuEater1), and then developed a fully-interactive fabric version that both changes shape and colour (ActuEater2). Four in-situ deployments of ‘ActuEaters’ in different dinner settings and subsequent ‘design crits’ showed insights into how people perceive, interpret and interact with such slow-technology in interesting (and often unexpected) ways. The results of our ‘ActuEating’ studies provide evidence for how an actuating artefact can be simultaneously a resource for social engagement and an interactive decorative. In response, we explore design opportunities for situating novel interactive materials in everyday settings, taking the leap into a new generation of interactive spaces, and critically considering new aesthetic possibilities